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Field of Invention 



The invention relates to the compilation of array-based languages, particularly to 
15 schemes that infer array shapes at compile time in languages such as MATLAB and APL. 

Background of Invention 



Certain high-level languages, such as MATLAB, SETL and APL, enjoy immense 
20 popularity in domains such as signal and image processing, and are often the language of 
choice for fast prototyping, data analysis and visualization. MATLAB is a proprietary 
programming language due to The MathWorks, Inc. The simplicity and ease of use of the 
language, coupled with the interactive nature of the MATLAB system makes it a 
productive environment for program development and analysis. However, MATLAB is 
25 slow in execution. One solution to the problem is to develop compilers that translate 

MATLAB programs to C code, and to then compile the generated C code into machine 
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code that runs much faster than the original MATLAB source. This approach is a difficult 
one, primarily because the MATLAB language lacks program declarations. Therefore, 
any automated approach would have to first contend with the problems of automatic type 
and shape inferencing. 

Array shape inferencing refers to the problem of deducing the dimensionality and 
extents of an array's shape at compile time. Shape inferencing in languages such as 
MATLAB is a difficult task, primarily due to the fact that such languages do not 
explicitly declare the shape of an array. On account of the dynamic binding of storage to 
names and the run time changes in basic data type and shape that these languages allow, 
interpreters are typically used to cope with their translation. Hence, shape inferencing is 
desirable from the standpoint of program compilation, since inferred shapes enable 
compile-time array conformability checking, memory preallocation optimizations, and 
efficient translations to "scalar" target languages. 

When the shape of a MATLAB program variable is not statically determinable, 
researchers have usually approached the problem by generating code that performs the 
inference at execution time. This code relies on ancillary variables called shadow 
variables that the compiler generates. The methodology is described in Luiz Antonio De 
Rose's Ph.D. dissertation titled Compiler Techniques for MATLAB Programs, and in the 
journal paper titled Techniques for the Translation of MATLAB Programs into Fortran 
90 by Luiz Antonio De Rose and David A. Padua. Both of these works are incorporated 
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by reference herein. Though such an approach is robust, it does not offer an opportunity 
for propagating an expression's shape across statements, when the expression's shape is 
unknown at compile time. That is, once shadow variables are introduced, useful shape 
information that could otherwise be propagated across expressions gets obscured. 

Previous attempts at automated approaches to inferencing revolved around the 

type determination problem. These were based on special mathematical structures called 

lattices. These structures are described in standard texts on discrete mathematics. Among 

the first of these attempts was type inferencing work by Marc A. Kaplan and Jeffrey D. 

Ullman. In a paper titled A Scheme for the Automatic Inference of Variable Types, which 

is hereby incorporated by reference, they proposed a general mathematical framework 

based on the theory of lattices that automatically inferred the types of variables in a model 

of computation that was an abstraction of programming languages such as APL, SETL 

and SNOBOL. Though the Kaplan et al. procedure can be carried over to MATLAB in a 

straightforward manner to also solve the problem of type inferencing, the same cannot be 

said as far as shape inferencing is concerned. For the Kaplan et al. approach to work, the 

type functions that model the type semantics of the language's operators must be 

monotonic with respect to the defined lattice. For some of MATLAB's built-in functions 

such as matrix multiply, it can be shown that the shape-tuple function that models the 

operation's shape semantics will not be monotonic with respect to any lattice that can be 

defined on the set of shape-tuples. Thus, existing lattice-based techniques have only 

limited scope for array shape inferencing in MATLAB. 
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Summary of Invention 

5 

This invention relates to an improved method using which array shape inferencing 
can be performed in the MATLAB programming language. Specifically, by algebraically 
representing the shape of a MATLAB expression, the invention provides a compact 
compile-time representation of shape, which does not obscure useful shape information 

10 from being propagated. The representation is exact in the sense that it does not depend on 
any compile-time overestimates for shape. This enables optimal memory allocation at run 
time. The representation reveals useful properties borne by MATLAB's built-in 
operations that can be leveraged for generating better code. Specific examples include 
avoiding array conformability checking at run time, preallocating memory for arrays, and 

15 enabling translation to equivalent scalarized forms. 
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Brief Description of Drawings 

FIG. 1 shows a sample MATLAB code fragment. 

5 

FIG. 2 illustrates the shape inferencing method according to the present invention. 

FIG. 3 shows a detailed flow chart of a preferred method in the shape inferencing 
process. 

FIG. 4 shows how array ranks can be computed for various built-in functions in 
MATLAB. In each case, the array ranks are determined as some function of the array 
ranks of the operands. 

FIG. 5 shows a representative list of shape-predicate and shape-tuple expressions 
for various built-in functions in MATLAB, These expressions mathematically model the 
correctness and the array extent aspects of shape respectively. 

FIG. 6 summarizes the algebraic properties that the shape-tuple class operators 
20 possess. 
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Detailed Description of Preferred Embodiment 

In the conventional shape inferencing method, called the shadow variable process, 
5 various ancillary variables are introduced at compile time for inferring an array's shape at 
execution time. This process is illustrated by reference to a sample code fragment shown 
in FIG.1. FIG.l shows an example of a MATLAB code fragment with assignment 
statement 10, 12, and 14. In statement 10, program variables a and b are operated by 
MATLAB's matrix multiply built-in function and the result is assigned to a program 
10 variable c. In statement 12, c and a are operated by the array addition built-in function 
and the result is assigned to d. Finally, statement 14 applies MATLAB's array subtraction 
operation to d and a and assigns the result to e. 

When the shapes of the program variables a and b are unknown at compile time, 

15 the conventional shadow variable approach will simply generate temporaries that 

represent the extents of c, d and e along their respective dimensions. The approach would 

then generate code against c, d and e that performs run-time array conformability 

checking for each of the assignments. However, even when array shapes are unknown at 

compile time, useful inferences can be made that could be used to generate better code. 

20 For example, in the case of the code fragment in FIG. 1, it is possible to statically infer 

that if the assignment to d in statement 12 succeeds, the subsequent assignment to e in 

statement 14 will also succeed, and that both e and d would then have exactly the same 
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shape. This enables the code generator to avoid generating array conformability checking 
code for the assignment to e, while the fact that d and e will always have the same shape 
can be exploited at a subsequent point in the program. The ability to perform such useful 
inferences under a general setting does not exist in the conventional shape inferencing 
5 method. A novel shape inferencing method with such abilities is illustrated in FIG. 2. 

A shape inferencing framework in accordance with the present invention is 
illustrated in FIG. 2, The notation <pi,p2, f Pk> denotes the shape-tuple of a MATLAB 
expression 20. Each component p l in the shape-tuple representation denotes the extent 

10 along the fth dimension (1< i< k) of a MATLAB expression. The shape-tuple notation 20 
therefore lists the extents of an array from left to right in the order of increasing 
dimensions. The framework determines the shape-tuple 26 of a MATLAB expression, 
given the shape-tuples 20 and 22 of its operands. Every MATLAB built-in function can 
have its shape semantics modeled algebraically by a shape-tuple operator. This is shown 

15 by 24 in FIG. 2 for the specific case of MATLAB's matrix multiply operator * . That is, 
is the shape-tuple operator that mimics the behavior of * in the shape domain. For 

instance, (2, 3) $ (3, 5) = (2, 5) since when a 2 x 3 matrix is multiplied with a 3 x 5 
matrix in MATLAB, the outcome is a 2 x 5 matrix. The "multiplication" in the last 
sentence refers to the MATLAB matrix multiply operation, which for the most part, 
20 shares the same semantics as the arithmetic matrix multiply operation taught in high- 
school mathematics. 
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A more detailed illustration of the shape inferencing method is shown in FIG. 3. 
In step 30, a MATLAB statement c = f (a, b) is shown where f denotes a built-in 
function. In this statement, a and b are the operand expressions and s and t are their shape 
5 tuples. In 34, a rank m is determined from the known ranks k and / of the operands. The 
term "rank" as defined here refers to the number of components in the associated shape- 
tuple. Thus, given s = <p It p 2 , pk>, t =<qi, q 2 ,..., ql>,rn needs to be determined 
first, and the shape-tuple u of c , u=<r; f r 2) r m >, is determined next. 

10 The computation of the rank m from the ranks k and / is dependent on the built-in 

function f . For example, if f in the above statement were the rand operator, then m would 
be 2. If f is MATLAB's array addition operator, then m would be max(£, I). FIG. 4 
documents the rank calculations for various built-in functions in MATLAB. In FIG. 4, 
R(a) and R(b) represent the ranks of a and b respectively. In situations where R(c) is 

15 used, a reaching definition for c is expected. 

After the rank of the result is computed 34, each of the shape-tuples s and t are 
"promoted" to m components, to produce s* and t* respectively. This promotion is 
20 performed in step 36 of the flow chart and may involve an expansion or truncation of the 
shape-tuples depending on whether m >k 9 1 or m< k, I In the case m > k or m > 1, an 
expansion needs to be performed and this occurs by appending trailing extents of unity. 
For example, when <3, 2, \> is expanded to 5 components, <3 5 2, 1, 1, 1> is obtained. 
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When <3, 2, 1> needs to be truncated to 2 components, <3 3 2> is obtained. By 
construction, the ranks must be at least 2. This implies that all shape-tuples will consist of 
at least two components each. 

5 The next step 38 is to determine which shape-tuple operator corresponds to the 

given built-in function. This is done by looking up a list of shape-predicate and shape- 
tuple expressions for the various built-in functions in MATLAB, as illustrated in FIG. 5. 
The column labeled u gives the particular expression that must be used to compute the 
shape-tuple of the result. In this computation, the shape-tuples are treated like integer 

10 square diagonal matrices as shown in Def. (1). Thus, the arithmetic involved in the 
computation of u is the usual matrix arithmetic. 



15 



<Pl, P2,.~,Pn> A 



pi 


0 


A 


0^ 


0 


pi 


A 


0 


M 


M 


0 


M 


0 


0 


A 


P»j 



(1) 



The quantities T \ 9 T2 and I shown in FIG. 5 represent m x m integer square diagonal 
matrices. In r i, only the first principal diagonal element is 1 and the rest are 0. In T2, 
20 only the second principal diagonal element is 1 and the rest are zero. The m x m identity 
matrix is represented by L Thus, in the shape-tuple notation, r 1= < 1, 0, 0, . . . , 0>, T 2= 
<0, 1 ? 0,..., 0>andl = <l, 1, 1,..., 1 >. 



10 



NWU-P005 



In FIG. 5, VP denotes a special integer matrix called the elementary square matrix. 
In form, this matrix looks like 



SF A 



fO 1 0 A 0^ 

1 0 0 A 0 

0 0 1 A 0 

M M M O M 

0 0 0 A 1 



(2) 



Any square matrix premultiplied and postmultiplied with the elementary square matrix 
will have its first two principal diagonal elements interchanged. For example, SF <2 ? 3, 4, 
10 5>Y = <3,2,4,5>. 



15 



The last integer square diagonal matrix corresponds to the symbol % * . Ill-formed 
expressions in MATLAB are considered to have the illegal shape-tuple n * . For instance, 
when a 2 x 3 matrix is multiplied with a 4 x 5 matrix in MATLAB, the run-time system 
will complain of an error. The concept of an illegal shape-tuple is meant to abstract such 
error situations. A possible embodiment for n * is 



7T*=<7Ti, 7T 2 , 1, 1> 



20 
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where either % \ or n 2 is a negative integer. The functions 0 ,a , j3 and 5 shown in FIG. 
3 are explained in the following text. The Dirac Delta function 5 is defined on the 
integer domain Z as follows: 

fO if /*0, 1 

5 5(i) A j lif . = 0 where/eZ (3) 

This function is well described in standard mathematical literature. Essentially, it maps 
nonzero integers to 0, and 0 to 1 . This is what Def. (3) indicates. Thea and jS functions 
also produce 0/1 outcomes. They operate on MATLAB expressions and identify scalars 
10 and matrices respectively. Specifically, 



f 1 if e is a MATLAB scalar, 
a(»A (4) 
— 10 otherwise, 



- f 1 if e is a MATLAB matrix, 
15 P(e)A\ (5) 

~ 0 otherwise. 



For example, ife were a 2 x 3 MATLAB matrix, then a (e) would be 0, while j3 (e) 
would be 1. It is possible to express the a (e) and /3 (e) functions in terms of the shape- 
20 tuple components using the Dirac Delta function. This is shown in Eq. (6) and Eq. (7), 
where it is assumed that < pi, P2, . . pk> represents the shape-tuple of e ; 

a 00 = S (pi - 1)5 O - 1) A 5 O - 1), (6) 

25 P 00 = 0 (e)8 (pi - 1) A 5 (pk - 1). (7) 

12 

NWU-P005 



The 6 function distinguishes an ill-formed MATLAB expression from a well- 
formed one by mapping the former to 0 and the latter to 1 . This function is called the 
shape-predicate. Put in another way, the shape-predicate will be 1 at run time for a well- 
defined MATLAB expression and 0 when a run-time error occurs. Various embodiments 
for the 0 function are possible. The specific embodiment chosen would depend on the 
choice for n * and does not affect the formulation of this framework. 

The following example should clarify the steps in the process. Let us reconsider 
the MATLAB statement c <r- a*b shown in FIG. 1 . Suppose that the shape-tuples 
associated with a and b are s = < pi, p 2 > and t = <q i? q 2 , q3> respectively. Therefore, 

k = 2, 

(pi Q\ 

s = 

{0 pi) 

and 

/ = 3, 







0 


°1 


t = 


0 


qi 


0 




1° 


0 


q 3y 



From FIG. 4, we get 

m = max(/c, /). 
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Hence, 

m = 3, 

5 

Therefore 





' ' p\ 


0 


°] 


s* = 


0 




0 




U 


0 






> 


0 






0 




0 






0 





15 

From Def.(6), we also have 

a (a)=5(/>.-l)50-l), ( 8 ) 
20 a (6) = 5 (# i - 1)5 (tf 2 - 1)5 ( ?3 - 1). (9) 

Looking up the shape-tuple operators in FIG. 5, we note the relevant shape-predicate and 
shape-tuple expressions for the MATLAB matrix multiply built-in function: 

25 

9(c) =6 (ajd (2>)(1 - (1 - a (a))(l - a{b)) (10) 

(i - p(a)p(b)8 (wr> - ?ro)), 

30 u= {l-8(c))Tc*+d(c)(s*a(b)+ (11) 

t*cT(a)(l-a(6)) + (j*ri + 

t*r2+i-ri-r 2 )(i-a(a)) 
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(!-«(£)))• 



In the above equations, the 5 function operates on integer square diagonal matrices, This 
5 operation is achieved by extending the definition of the Dirac Delta function in Def.(3) to 
integer square diagonal matrices; 



10 



5((n ? n, ...,,rm))A S(n)S(r2)A S(r m ) 



(12) 



where rj, r 2 , . . . Tm e Z. Plugging the expressions for a (a) from Eq. (8) and for a (b) 
from Eq. (9) into Eq. (10), we obtain 



15 



20 



0 (c) - 6 (a)Q (6)(1 - (1 - 5 (pi - 1)5 (pi - 1)) 
a-5(?i-l)5( 9 2-l)5( ? 3-l)) 
(1-9 (a)9 (6)5 (qs - 1)5 Q?2 - qi))). 

Hence from Eq. (1 1), we get the shape-tuple u for c to be 



(x 0 o x 

0 Y 0 

v o 0 z y 



<X,Y,Z>, 



25 



30 



where 



X = 0 (c)(pia(b) + q\a{a){\ - a(b)) + 

pil - a (a))(l - a (b))) + (1 - 0 (c))jci, 

Y = 0 (6) + ? ja (a)(l - a (&)) + 

92(1 - a (a))(l - a (Z>))) + (1 -0 (c))m, 
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t 



Z = 6 (c)(a(b) + qsa (a)(l - a (&)) + 
(l-a(a))(l-a(A))) + (l-0(^)X 

5 and where ^ = <7r i,7i2,l>. Thus, if the respective values for < pi, p2> and <qi, q2, q3> 

were <3, 2> and <4, 4, 1> at run time (say), 6 (c) would become 0, giving n * for u. The 
point is that we now have a compact compile-time representation for the shape-tuple of c 
that takes into account all possibilities, 

10 In the above example, the shape-tuples s and t were used to compute the shape- 

tuple u. In general, the shape inferencing process will begin by considering the shape- 
tuples of all known scalar constants tobe<l,l,...,l> and will then proceed to compute 
new shape-tuples by forward propagating the already computed shape-tuples. 

15 

The algebraic formulation in FIG. 5 of MATLAB f s shape semantics has another 
advantage in addition to enabling a compact compile-time representation: It uncovers 
interesting algebraic properties borne by MATLAB's built-in functions in the shape 
domain. First of all, each of the shape-tuple operators shown in FIG. 5 form special 
20 mathematical structures called algebraic systems. Algebraic systems are discussed in 

standard texts on discrete mathematics. The book titled Discrete Mathematical Structures 
with Applications to Computer Science by J. P. Tremblay and R. Manohar is suggested as 
a reference. 
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Second, each of the shape-tuple operators shown in FIG. 5 exhibit a special 
characteristic known as the substitution property. We discuss this property by beginning 
with the notion of equivalent shape-tuples. In MATLAB, any m-dimensional array can 
5 always be considered as an n-dimensional array where m < n, simply by regarding the 
higher dimensions to have unit extents. Since higher dimensions are indicated to the right 
of lower dimensions in the shape-tuple notation, trailing extents of unity in a shape-tuple 
are effectively of no significance to an array's shape in MATLAB. In other words, the 
shape-tuples <2, 3, 4>, <2, 3, 4,1>, <2, 3, 4, 1, \> and so on are all equally qualified to 
10 represent the shape of an array having three dimensions, with the extents 2, 3 and 4 along 
the first, second and third dimensions respectively. We therefore say that these shape- 
tuples are MATLAB-equivalent 

The concept of equivalent shape-tuples can be used to define an equivalence relation p 
15 on the set of shape-tuples. Two shape-tuples mi and m2 are said to be related by p if they 
are MATLAB-equivalent. That is, mi p m 2 if and only if either mi and m2 are identical 
or differ by trailing extents of unity from the third component on. It can be shown that if. 
is a shape-tuple operator in FIG. 5, then 

20 (S ■ t) p (s' f) 



17 



NWU-P005 



where sp s' and tp t'. What this means is that, if s and t in s t is substituted by the 

MATLAB-equivalent shape-tuples s' and t\ then we are guaranteed to arrive at a shape- 
tuple that is MATLAB-equivalent tost It is this particular characteristic that is called 
the substitution property. The substitution property is also documented in standard texts 

5 on discrete mathematics. This key observation enables us to substitute every shape-tuple 
operator by a shape-tuple class operator that works on the equivalence classes of the 
relation p . Relations such as p that satisfy the substitution property with respect to some 
algebraic system are usually called congruence relations. Such relations enable the 
construction of new and simpler algebraic systems from a given algebraic system. For 

10 example, in the case of the (^shape-tuple operator, we can consider the simpler ® shape- 
tuple class operator. 

Each of the shape-tuple class operators can be shown to possess or not possess important 
algebraic properties. These algebraic properties are tabulated in FIG.6. In the column 
15 labeled ' Identity, " i represents the class of shape-tuples equivalent to the scalar shape- 
tuple < 1, 1> Whenever a shape-tuple class operator • has the identity element /, the 
following will hold for all shape-tuple classes s: 



20 



S • l = 1 • S = S 

These properties are exploited in the novel shape inferencing method as illustrated in the 
following examples. 

Example 1 : Comparisons with the Shadow Variable Approach 
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Let us reconsider the code fragment shown in FIG. 1 . In the shadow variable 
approach, the static inferencing mechanism will fail because the extents of the matrices a 
5 and b will not be known exactly at compile time. For both a and b, shadow variables will 
be generated at compile time to resolve the shape information at run time. The approach 
will not attempt to infer at compile time that if the assignment to d succeeds, the 
subsequent assignment to e will also succeed and that both e and d would then have the 
same shapes. 

10 

In the proposed framework, we obtain the following two equations corresponding to those 
two statements by looking up the table in FIG.5: 

u = s © t, (Eg: 1.1) 

15 

v = u © t. (Eg: 1.2) 

20 where s, t, u and v represent the shape-tuple classes of the program variables c, a, d and 
e respectively. By substituting Eq. (Eg: 1.1) into Eq. (Eg: 1.2), we obtain 

v = (s © t) ©t 

25 

From FIG.6, © is associative. Therefore, 

v - s © (t © t). 

30 
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5 



From FIG. 6, ® also satisfies the idempotent law. Therefore, the last equation becomes 

v = s 8 t (Eg: 1.3) 



Comparing Eq.(Eg:Ll) and Eq.(Eg:1.3) ? we therefore conclude 



10 



v = 



u. 



(Eg:1.4) 



Thus, if the assignment to d succeeds (in which case u won't be n ), the subsequent 
15 assignment to e will also succeed and then both e and d would have exactly the same 
shape. Therefore at run time, we need to only perform conformability checking for the 
first statement and not the second. Observe that this result is deducible by the framework, 
even when a and b are arbitrary arrays, not necessarily just matrices. Moreover, the fact 
that d and e will always have the same shape is an important inference that can be 
20 capitalized upon at a subsequent point in the program. Such generalized deductions are 
not easily possible in the conventional shadow variable scheme. 

Example 2: Inferring in the Presence of Loops 



25 



Consider the following code fragment that involves a while loop: 



30 



Si: 

S 2 : 

S 3 : 
S 4 : 

S 5 : 
S 6 : 



a<-A ; 
b<-A ; 
while (...), 



end; 



c a. * b; 



a^c; 
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From statement S4 and FIG. 5, we get 

u, = s w © t (Eg:2.1) 

where u, and s, indicate the respective shape-tuple classes of c and a in the zth iteration 

(/> 1) of the loop. 

From statement S 5 , we also have 

s, = u, (Eg:2.2) 

Hence, by substituting Eq.(Eg:2.1) into Eq.(Eg:2.2), we arrive at 
S, = Sj-i © t. 
.\ S/ = (S..2 © t) © t 

From FIG.6, ffi is associative. Hence 

S z = Si_2 © (t © t). 

Applying the idempotent law, the last equation becomes 

S z = ©t. 

Proceeding thus, we therefore arrive at the following: 
s z = s 0 ©tforall/>L (Eg:2.3) 
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The above result is important because it leads to the following useful inferences and 
optimizations: 

1 . If the assignments to a and b in statements Si and S2 are shape correct, then the code 
5 fragment itself is shape correct so long as a and b are initially shape conforming with 

respect to the .* built-in function. 

2. We now know that c 's shape will remain the same throughout the loop's execution. 

3. The result indicates that a could potentially change shape only at the first iteration. 

10 

4. The result therefore enables us to preallocate c and resize a before executing the loop. 



15 Foregoing described embodiments of the invention are provided as illustrations 

and descriptions. They are not intended to limit the invention to the form described. In 
particular, it is contemplated that the invention described herein may be implemented 
equivalently in hardware, software, firmware, and/or using other available functional 
components or building blocks. Other variations and embodiments are possible in light 

20 of the above presentation, and it is thus intended that this Detailed Description not limit 
the scope of the invention, but rather by the claims that follow. 
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